Perfect Sampling of Harris Recurrent Markov Chains
نویسنده
چکیده
We develop an algorithm for simulating \perfect" random samples from the invariant measure of a Harris recurrent Markov chain. The method uses backward coupling of embedded regeneration times, and works most eeectively for nite chains and for stochas-tically monotone chains even on continuous spaces, where paths may be sandwiched below \upper" and \lower" processes. Examples show that more naive approaches to constructing such bounding processes may be considerably biased, but that the algorithm can be simpliied in certain cases to make it easier to run. We give explicit analytic bounds on the backward coupling times in the stochastically monotone case. An application of the simpler algorithm to storage models is given.
منابع مشابه
Generalized Resolvents and Harris Recurrence of Markov Processes
In this paper we consider a φ-irreducible continuous parameter Markov process Φ whose state space is a general topological space. The recurrence and Harris recurrence structure of Φ is developed in terms of generalized forms of resolvent chains, where we allow statemodulated resolvents and embedded chains with arbitrary sampling distributions. We show that the recurrence behavior of such genera...
متن کاملFurther Criteria for Positive Harris Recurrence of Markov Chains
We provide several necessary and sufficient conditions for a Markov chain on a general state space to be positive Harris recurrent. The conditions only concern asymptotic properties of the expected occupation measures.
متن کاملRegeneration-based statistics for Harris recurrent Markov chains
Harris Markov chains make their appearance in many areas of statistical modeling, in particular in time series analysis. Recent years have seen a rapid growth of statistical techniques adapted to data exhibiting this particular pattern of dependence. In this paper an attempt is made to present how renewal properties of Harris recurrent Markov chains or of specific extensions of the latter may b...
متن کاملHarris Recurrence of Metropolis-Within-Gibbs and Trans-Dimensional Markov Chains
A φ-irreducible and aperiodic Markov chain with stationary probability distribution will converge to its stationary distribution from almost all starting points. The property of Harris recurrence allows us to replace “almost all” by “all,” which is potentially important when running Markov chain Monte Carlo algorithms. Full-dimensional Metropolis–Hastings algorithms are known to be Harris recur...
متن کاملWide-sense regeneration for Harris recurrent Markov processes: an open problem
Harris recurrence is a widely used tool in the analysis of queueing systems. For discrete-time Harris chains, such systems automatically exhibit wide-sense regenerative structure, so that renewal theory can be applied to questions related to convergence of the transition probabilities to the equilibrium distribution. By contrast, in continuous time, the question of whether all Harris recurrent ...
متن کامل